Pandas Profiling Report

Dataset statistics

Number of variables	30
Number of observations	100000
Missing cells	222977
Missing cells (%)	7.4%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	22.9 MiB
Average record size in memory	240.0 B

Variable types

CAT	21
NUM	6
BOOL	2
DATE	1

Warnings

`crash_time` has a high cardinality: 1440 distinct values	High cardinality
`zip_code` has a high cardinality: 203 distinct values	High cardinality
`latitude` has a high cardinality: 33676 distinct values	High cardinality
`longitude` has a high cardinality: 26495 distinct values	High cardinality
`location` has a high cardinality: 44606 distinct values	High cardinality
`on_street_name` has a high cardinality: 4327 distinct values	High cardinality
`off_street_name` has a high cardinality: 4897 distinct values	High cardinality
`cross_street_name` has a high cardinality: 22829 distinct values	High cardinality
`nearest_street` has a high cardinality: 27727 distinct values	High cardinality
`combine_location` has a high cardinality: 44606 distinct values	High cardinality
`number_of_motorist_injured` is highly correlated with `number_of_persons_injured`	High correlation
`number_of_persons_injured` is highly correlated with `number_of_motorist_injured`	High correlation
`crash_year` is highly correlated with `collision_id`	High correlation
`collision_id` is highly correlated with `crash_year`	High correlation
`borough` has 35026 (35.0%) missing values	Missing
`zip_code` has 35034 (35.0%) missing values	Missing
`on_street_name` has 26009 (26.0%) missing values	Missing
`off_street_name` has 52875 (52.9%) missing values	Missing
`cross_street_name` has 74033 (74.0%) missing values	Missing
`cross_street_name` is uniformly distributed	Uniform
`collision_id` has unique values	Unique
`number_of_persons_injured` has 72699 (72.7%) zeros	Zeros
`number_of_pedestrians_injured` has 95454 (95.5%) zeros	Zeros
`number_of_motorist_injured` has 81887 (81.9%) zeros	Zeros

Reproduction

Analysis started	2020-12-12 13:39:51.104124
Analysis finished	2020-12-12 13:40:19.028106
Duration	27.92 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

crash_date
Date

Distinct	551
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Minimum	2013-03-23 00:00:00
Maximum	2020-09-29 00:00:00

Histogram

Histogram with fixed size bins (bins=50)

crash_time
Categorical

HIGH CARDINALITY

Distinct	1440
Distinct (%)	1.4%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

0:00	1637
17:00	1363
16:00	1360
14:00	1298
15:00	1246
Other values (1435)	93096

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
0:00	1637	1.6%
17:00	1363	1.4%
16:00	1360	1.4%
14:00	1298	1.3%
15:00	1246	1.2%
18:00	1231	1.2%
13:00	1153	1.2%
12:00	1103	1.1%
19:00	996	1.0%
10:00	971	1.0%
Other values (1430)	87642	87.6%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	5
Median length	5
Mean length	4.74399
Min length	4

borough
Categorical

MISSING

Distinct	5
Distinct (%)	< 0.1%
Missing	35026
Missing (%)	35.0%
Memory size	781.2 KiB

BROOKLYN	22118
QUEENS	18322
BRONX	11927
MANHATTAN	10637
STATEN ISLAND	1970

Frequencies
Length

Value	Count	Frequency (%)
BROOKLYN	22118	22.1%
QUEENS	18322	18.3%
BRONX	11927	11.9%
MANHATTAN	10637	10.6%
STATEN ISLAND	1970	2.0%
(Missing)	35026	35.0%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	13
Median length	6
Mean length	5.72932
Min length	3

zip_code
Categorical

HIGH CARDINALITY
MISSING

Distinct	203
Distinct (%)	0.3%
Missing	35034
Missing (%)	35.0%
Memory size	781.2 KiB

11207	1510
11236	1175
11212	1088
11208	1071
11385	1015
Other values (198)	59107

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
11207	1510	1.5%
11236	1175	1.2%
11212	1088	1.1%
11208	1071	1.1%
11385	1015	1.0%
11203	988	1.0%
11434	960	1.0%
11234	931	0.9%
11226	923	0.9%
11368	864	0.9%
Other values (193)	54441	54.4%
(Missing)	35034	35.0%

Frequencies of value counts

Unique

Unique	12 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	5
Median length	5
Mean length	4.29932
Min length	3

latitude
Categorical

HIGH CARDINALITY

Distinct	33676
Distinct (%)	33.7%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

nan	8035
0.0	169
40.861862	79
40.8047	56
40.820305	52
Other values (33671)	91609

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
nan	8035	8.0%
0.0	169	0.2%
40.861862	79	0.1%
40.8047	56	0.1%
40.820305	52	0.1%
40.675734999999996	48	< 0.1%
40.696033	48	< 0.1%
40.658577	47	< 0.1%
40.737784999999995	45	< 0.1%
40.651863	43	< 0.1%
Other values (33666)	91378	91.4%

Frequencies of value counts

Unique

Unique	16219 ?
Unique (%)	16.2%

Histogram of lengths of the category

Length

Max length	18
Median length	9
Mean length	9.84755
Min length	3

longitude
Categorical

HIGH CARDINALITY

Distinct	26495
Distinct (%)	26.5%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

nan	8035
0.0	169
-73.91282	83
-73.89063	73
-73.91243	61
Other values (26490)	91579

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
nan	8035	8.0%
0.0	169	0.2%
-73.91282	83	0.1%
-73.89063	73	0.1%
-73.91243	61	0.1%
-73.89083000000001	58	0.1%
-73.89686	53	0.1%
-73.98453	52	0.1%
-73.93755	47	< 0.1%
-73.96191	46	< 0.1%
Other values (26485)	91323	91.3%

Frequencies of value counts

Unique

Unique	10002 ?
Unique (%)	10.0%

Histogram of lengths of the category

Length

Max length	18
Median length	9
Mean length	10.21951
Min length	3

location
Categorical

HIGH CARDINALITY

Distinct	44606
Distinct (%)	44.6%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

(nannan)	8035
(0.0, 0.0)	169
(40.861862, -73.91282)	79
(40.8047, -73.91243)	55
(40.820305, -73.89083)	52
Other values (44601)	91610

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
(nannan)	8035	8.0%
(0.0, 0.0)	169	0.2%
(40.861862, -73.91282)	79	0.1%
(40.8047, -73.91243)	55	0.1%
(40.820305, -73.89083)	52	0.1%
(40.675735, -73.89686)	48	< 0.1%
(40.696033, -73.98453)	48	< 0.1%
(40.658577, -73.89063)	47	< 0.1%
(40.737785, -73.93496)	43	< 0.1%
(40.733536, -73.87035)	41	< 0.1%
Other values (44596)	91383	91.4%

Frequencies of value counts

Unique

Unique	29003 ?
Unique (%)	29.0%

Histogram of lengths of the category

Length

Max length	25
Median length	22
Mean length	20.60857
Min length	8

on_street_name
Categorical

HIGH CARDINALITY
MISSING

Distinct	4327
Distinct (%)	5.8%
Missing	26009
Missing (%)	26.0%
Memory size	781.2 KiB

BELT PARKWAY	1616
LONG ISLAND EXPRESSWAY	1053
BROOKLYN QUEENS EXPRESSWAY	956
BROADWAY	863
FDR DRIVE	852
Other values (4322)	68651

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
BELT PARKWAY	1616	1.6%
LONG ISLAND EXPRESSWAY	1053	1.1%
BROOKLYN QUEENS EXPRESSWAY	956	1.0%
BROADWAY	863	0.9%
FDR DRIVE	852	0.9%
GRAND CENTRAL PKWY	820	0.8%
ATLANTIC AVENUE	717	0.7%
MAJOR DEEGAN EXPRESSWAY	674	0.7%
CROSS BRONX EXPY	652	0.7%
CROSS ISLAND PARKWAY	605	0.6%
Other values (4317)	65183	65.2%
(Missing)	26009	26.0%

Frequencies of value counts

Unique

Unique	1369 ?
Unique (%)	1.9%

Histogram of lengths of the category

Length

Max length	32
Median length	32
Mean length	24.45739
Min length	3

off_street_name
Categorical

HIGH CARDINALITY
MISSING

Distinct	4897
Distinct (%)	10.4%
Missing	52875
Missing (%)	52.9%
Memory size	781.2 KiB

3 AVENUE	432
BROADWAY	424
2 AVENUE	340
LINDEN BOULEVARD	280
5 AVENUE	247
Other values (4892)	45402

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
3 AVENUE	432	0.4%
BROADWAY	424	0.4%
2 AVENUE	340	0.3%
LINDEN BOULEVARD	280	0.3%
5 AVENUE	247	0.2%
ATLANTIC AVENUE	240	0.2%
1 AVENUE	237	0.2%
7 AVENUE	229	0.2%
PARK AVENUE	222	0.2%
QUEENS BOULEVARD	218	0.2%
Other values (4887)	44256	44.3%
(Missing)	52875	52.9%

Frequencies of value counts

Unique

Unique	1704 ?
Unique (%)	3.6%

Histogram of lengths of the category

Length

Max length	32
Median length	3
Mean length	7.80378
Min length	1

cross_street_name
Categorical

HIGH CARDINALITY
MISSING
UNIFORM

Distinct	22829
Distinct (%)	87.9%
Missing	74033
Missing (%)	74.0%
Memory size	781.2 KiB

772 EDGEWATER ROAD	35
501 GATEWAY DRIVE	21
90-15 QUEENS BOULEVARD	19
123-01 ROOSEVELT AVENUE	18
2100 BARTOW AVENUE	14
Other values (22824)	25860

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
772 EDGEWATER ROAD	35	< 0.1%
501 GATEWAY DRIVE	21	< 0.1%
90-15 QUEENS BOULEVARD	19	< 0.1%
123-01 ROOSEVELT AVENUE	18	< 0.1%
2100 BARTOW AVENUE	14	< 0.1%
985 RICHMOND AVENUE	13	< 0.1%
135-05 20 AVENUE	12	< 0.1%
355 FOOD CENTER DRIVE	12	< 0.1%
1 ORCHARD BEACH ROAD	12	< 0.1%
815 HUTCHINSON RIVER PARKWAY	12	< 0.1%
Other values (22819)	25799	25.8%
(Missing)	74033	74.0%

Frequencies of value counts

Unique

Unique	20794 ?
Unique (%)	80.1%

Histogram of lengths of the category

Length

Max length	40
Median length	3
Mean length	12.60779
Min length	3

number_of_persons_injured
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.37196
Minimum	0
Maximum	15
Zeros	72699
Zeros (%)	72.7%
Memory size	781.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	2
Maximum	15
Range	15
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.7439161865
Coefficient of variation (CV)	1.999989748
Kurtosis	16.5808926
Mean	0.37196
Median Absolute Deviation (MAD)	0
Skewness	3.147118256
Sum	37196
Variance	0.5534112925
Monotocity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
0	72699	72.7%
1	21011	21.0%
2	4125	4.1%
3	1308	1.3%
4	523	0.5%
5	196	0.2%
6	77	0.1%
7	36	< 0.1%
8	14	< 0.1%
9	5	< 0.1%
Other values (3)	6	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	72699	72.7%
1	21011	21.0%
2	4125	4.1%
3	1308	1.3%
4	523	0.5%

Value	Count	Frequency (%)
15	1	< 0.1%
11	3	< 0.1%
10	2	< 0.1%
9	5	< 0.1%
8	14	< 0.1%

number_of_persons_killed
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

0	99816
1	176
2	7
3	1

Frequencies
Length

Value	Count	Frequency (%)
0	99816	99.8%
1	176	0.2%
2	7	< 0.1%
3	1	< 0.1%

Frequencies of value counts

Unique

Unique	1 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

number_of_pedestrians_injured
Real number (ℝ_≥0)

ZEROS

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.04739
Minimum	0
Maximum	6
Zeros	95454
Zeros (%)	95.5%
Memory size	781.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	6
Range	6
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.2234383296
Coefficient of variation (CV)	4.714883512
Kurtosis	38.41899762
Mean	0.04739
Median Absolute Deviation (MAD)	0
Skewness	5.270026474
Sum	4739
Variance	0.04992468715
Monotocity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
0	95454	95.5%
1	4383	4.4%
2	142	0.1%
3	17	< 0.1%
6	2	< 0.1%
5	1	< 0.1%
4	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	95454	95.5%
1	4383	4.4%
2	142	0.1%
3	17	< 0.1%
4	1	< 0.1%

Value	Count	Frequency (%)
6	2	< 0.1%
5	1	< 0.1%
4	1	< 0.1%
3	17	< 0.1%
2	142	0.1%

number_of_pedestrians_killed
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

0	99936
1	64

Common Values
Chart

Value	Count	Frequency (%)
0	99936	99.9%
1	64	0.1%

number_of_cyclist_injured
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

0	95147
1	4744
2	107
3	2

Frequencies
Length

Value	Count	Frequency (%)
0	95147	95.1%
1	4744	4.7%
2	107	0.1%
3	2	< 0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

number_of_cyclist_killed
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

0	99975
1	25

Common Values
Chart

Value	Count	Frequency (%)
0	99975	> 99.9%
1	25	< 0.1%

number_of_motorist_injured
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	13
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.27492
Minimum	0
Maximum	15
Zeros	81887
Zeros (%)	81.9%
Memory size	781.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	2
Maximum	15
Range	15
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.711058401
Coefficient of variation (CV)	2.586419326
Kurtosis	21.76181987
Mean	0.27492
Median Absolute Deviation (MAD)	0
Skewness	3.819224309
Sum	27492
Variance	0.5056040496
Monotocity	Not monotonic

Histogram with fixed size bins (bins=13)

Value	Count	Frequency (%)
0	81887	81.9%
1	12243	12.2%
2	3767	3.8%
3	1259	1.3%
4	523	0.5%
5	189	0.2%
6	73	0.1%
7	34	< 0.1%
8	14	< 0.1%
9	5	< 0.1%
Other values (3)	6	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	81887	81.9%
1	12243	12.2%
2	3767	3.8%
3	1259	1.3%
4	523	0.5%

Value	Count	Frequency (%)
15	1	< 0.1%
11	3	< 0.1%
10	2	< 0.1%
9	5	< 0.1%
8	14	< 0.1%

number_of_motorist_killed
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

0	99904
1	89
2	6
3	1

Frequencies
Length

Value	Count	Frequency (%)
0	99904	99.9%
1	89	0.1%
2	6	< 0.1%
3	1	< 0.1%

Frequencies of value counts

Unique

Unique	1 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

contributing_factor_vehicle_1
Categorical

Distinct	16
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Driver Inattention/Distraction	25605
Unspecified	25253
Following Too Closely	7530
Other factor	6994
Failure to Yield Right-of-Way	6023
Other values (11)	28595

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Driver Inattention/Distraction	25605	25.6%
Unspecified	25253	25.3%
Following Too Closely	7530	7.5%
Other factor	6994	7.0%
Failure to Yield Right-of-Way	6023	6.0%
Backing Unsafely	4033	4.0%
Passing or Lane Usage Improper	3979	4.0%
Passing Too Closely	3676	3.7%
Other Vehicular	3071	3.1%
Unsafe Lane Changing	2588	2.6%
Other values (6)	11248	11.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	30
Median length	19
Mean length	20.43398
Min length	11

contributing_factor_vehicle_2
Categorical

Distinct	17
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Unspecified	67739
Other factor	19861
Driver Inattention/Distraction	5284
Following Too Closely	1296
Other Vehicular	1249
Other values (12)	4571

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Unspecified	67739	67.7%
Other factor	19861	19.9%
Driver Inattention/Distraction	5284	5.3%
Following Too Closely	1296	1.3%
Other Vehicular	1249	1.2%
Passing or Lane Usage Improper	802	0.8%
Failure to Yield Right-of-Way	716	0.7%
Passing Too Closely	538	0.5%
Unsafe Lane Changing	402	0.4%
Unsafe Speed	383	0.4%
Other values (7)	1730	1.7%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	53
Median length	11
Mean length	13.00979
Min length	11

contributing_factor_vehicle_3
Categorical

Distinct	5
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Other factor	91338
Unspecified	8197
Following Too Closely	176
Other Vehicular	171
Driver Inattention/Distraction	118

Frequencies
Length

Value	Count	Frequency (%)
Other factor	91338	91.3%
Unspecified	8197	8.2%
Following Too Closely	176	0.2%
Other Vehicular	171	0.2%
Driver Inattention/Distraction	118	0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	30
Median length	12
Mean length	11.96024
Min length	11

collision_id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	100000
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	4226109.341
Minimum	2568
Maximum	4353706
Zeros	0
Zeros (%)	0.0%
Memory size	781.2 KiB

Quantile statistics

Minimum	2568
5-th percentile	3665427.95
Q1	4182342.75
median	4300224
Q3	4328315.25
95-th percentile	4348345.05
Maximum	4353706
Range	4351138
Interquartile range (IQR)	145972.5

Descriptive statistics

Standard deviation	165356.0511
Coefficient of variation (CV)	0.03912725341
Kurtosis	45.22161792
Mean	4226109.341
Median Absolute Deviation (MAD)	51882.5
Skewness	-3.965406795
Sum	4.226109341e+11
Variance	2.734262364e+10
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4196351	1	< 0.1%
4196884	1	< 0.1%
4303971	1	< 0.1%
4335798	1	< 0.1%
4159994	1	< 0.1%
4321918	1	< 0.1%
4167876	1	< 0.1%
4310832	1	< 0.1%
4318727	1	< 0.1%
4319172	1	< 0.1%
Other values (99990)	99990	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2568	1	< 0.1%
69010	1	< 0.1%
74294	1	< 0.1%
127733	1	< 0.1%
210591	1	< 0.1%

Value	Count	Frequency (%)
4353706	1	< 0.1%
4353705	1	< 0.1%
4353701	1	< 0.1%
4353672	1	< 0.1%
4353663	1	< 0.1%

vehicle_type_code_1
Categorical

Distinct	9
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Sedan	46790
Station Wagon/Sport Utility Vehicle	35766
Other factor	6477
Taxi	3478
Pick-up Truck	2615
Other values (4)	4874

Frequencies
Length

Value	Count	Frequency (%)
Sedan	46790	46.8%
Station Wagon/Sport Utility Vehicle	35766	35.8%
Other factor	6477	6.5%
Taxi	3478	3.5%
Pick-up Truck	2615	2.6%
Box Truck	1946	1.9%
Bike	1437	1.4%
Tractor Truck Diesel	751	0.8%
unspecified	740	0.7%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	35
Median length	5
Mean length	16.57813
Min length	4

vehicle_type_code_2
Categorical

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Sedan	31369
unspecified	26589
Station Wagon/Sport Utility Vehicle	24773
Other factor	4450
Bike	3586
Other values (6)	9233

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
Sedan	31369	31.4%
unspecified	26589	26.6%
Station Wagon/Sport Utility Vehicle	24773	24.8%
Other factor	4450	4.5%
Bike	3586	3.6%
Taxi	2300	2.3%
Pick-up Truck	2282	2.3%
Box Truck	2146	2.1%
Bus	1011	1.0%
Tractor Truck Diesel	763	0.8%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	35
Median length	11
Mean length	14.67906
Min length	3

vehicle_type_code_3
Categorical

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Other factor	92036
Sedan	4129
Station Wagon/Sport Utility Vehicle	3380
Pick-up Truck	195
Taxi	187

Frequencies
Length

Value	Count	Frequency (%)
Other factor	92036	92.0%
Sedan	4129	4.1%
Station Wagon/Sport Utility Vehicle	3380	3.4%
Pick-up Truck	195	0.2%
Taxi	187	0.2%
Box Truck	73	0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	35
Median length	12
Mean length	12.47317
Min length	4

crash_day
Categorical

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

Friday	15494
Tuesday	14653
Thursday	14573
Wednesday	14285
Monday	14242
Other values (2)	26753

Frequencies
Length

Value	Count	Frequency (%)
Friday	15494	15.5%
Tuesday	14653	14.7%
Thursday	14573	14.6%
Wednesday	14285	14.3%
Monday	14242	14.2%
Saturday	13964	14.0%
Sunday	12789	12.8%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	9
Median length	7
Mean length	7.14582
Min length	6

crash_month
Real number (ℝ_≥0)

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	7.02299
Minimum	2
Maximum	12
Zeros	0
Zeros (%)	0.0%
Memory size	781.2 KiB

Quantile statistics

Minimum	2
5-th percentile	4
Q1	6
median	7
Q3	8
95-th percentile	9
Maximum	12
Range	10
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.828325706
Coefficient of variation (CV)	0.2603343741
Kurtosis	0.02879865261
Mean	7.02299
Median Absolute Deviation (MAD)	1
Skewness	-0.2523065626
Sum	702299
Variance	3.342774888
Monotocity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
8	26950	27.0%
7	23589	23.6%
9	13226	13.2%
6	11646	11.6%
5	8426	8.4%
4	7679	7.7%
3	4133	4.1%
11	3603	3.6%
12	506	0.5%
10	154	0.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	88	0.1%
3	4133	4.1%
4	7679	7.7%
5	8426	8.4%
6	11646	11.6%

Value	Count	Frequency (%)
12	506	0.5%
11	3603	3.6%
10	154	0.2%
9	13226	13.2%
8	26950	27.0%

crash_year
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2019.37856
Minimum	2013
Maximum	2020
Zeros	0
Zeros (%)	0.0%
Memory size	781.2 KiB

Quantile statistics

Minimum	2013
5-th percentile	2017
Q1	2019
median	2020
Q3	2020
95-th percentile	2020
Maximum	2020
Range	7
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.7793320217
Coefficient of variation (CV)	0.0003859266594
Kurtosis	3.639582223
Mean	2019.37856
Median Absolute Deviation (MAD)	0
Skewness	-1.657671392
Sum	201937856
Variance	0.6073584
Monotocity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
2020	50037	50.0%
2019	43881	43.9%
2017	5871	5.9%
2018	148	0.1%
2015	43	< 0.1%
2013	19	< 0.1%
2014	1	< 0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2013	19	< 0.1%
2014	1	< 0.1%
2015	43	< 0.1%
2017	5871	5.9%
2018	148	0.1%

Value	Count	Frequency (%)
2020	50037	50.0%
2019	43881	43.9%
2018	148	0.1%
2017	5871	5.9%
2015	43	< 0.1%

nearest_street
Categorical

HIGH CARDINALITY

Distinct	27727
Distinct (%)	27.7%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

nan	26908
3 AVENUE	432
BROADWAY	424
2 AVENUE	340
LINDEN BOULEVARD	280
Other values (27722)	71616

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
nan	26908	26.9%
3 AVENUE	432	0.4%
BROADWAY	424	0.4%
2 AVENUE	340	0.3%
LINDEN BOULEVARD	280	0.3%
5 AVENUE	247	0.2%
ATLANTIC AVENUE	240	0.2%
1 AVENUE	237	0.2%
7 AVENUE	229	0.2%
PARK AVENUE	222	0.2%
Other values (27717)	70441	70.4%

Frequencies of value counts

Unique

Unique	22498 ?
Unique (%)	22.5%

Histogram of lengths of the category

Length

Max length	40
Median length	13
Mean length	17.41157
Min length	1

combine_location
Categorical

HIGH CARDINALITY

Distinct	44606
Distinct (%)	44.6%
Missing	0
Missing (%)	0.0%
Memory size	781.2 KiB

(nannan)	8035
(0.00.0)	169
(40.861862-73.91282)	79
(40.8047-73.91243)	55
(40.820305-73.89083000000001)	52
Other values (44601)	91610

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
(nannan)	8035	8.0%
(0.00.0)	169	0.2%
(40.861862-73.91282)	79	0.1%
(40.8047-73.91243)	55	0.1%
(40.820305-73.89083000000001)	52	0.1%
(40.696033-73.98453)	48	< 0.1%
(40.675734999999996-73.89686)	48	< 0.1%
(40.658577-73.89063)	47	< 0.1%
(40.737784999999995-73.93496)	43	< 0.1%
(40.733536-73.87035)	41	< 0.1%
Other values (44596)	91383	91.4%

Frequencies of value counts

Unique

Unique	29003 ?
Unique (%)	29.0%

Histogram of lengths of the category

Length

Max length	38
Median length	20
Mean length	22.06706
Min length	8

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	crash_date	crash_time	borough	zip_code	latitude	longitude	location	on_street_name	off_street_name	cross_street_name	number_of_persons_injured	number_of_pedestrians_injured	number_of_motorist_injured	contributing_factor_vehicle_1	contributing_factor_vehicle_2	contributing_factor_vehicle_3	collision_id	vehicle_type_code_1	vehicle_type_code_2	vehicle_type_code_3	crash_day	crash_month	crash_year	nearest_street	combine_location
0	2017-04-18	23:10	STATEN ISLAND	10312	40.536728000000004	-74.193344	(40.536728, -74.193344)	NaN	NaN	243 DARLINGTON AVENUE	0	0	0	Driver Inattention/Distraction	Unspecified	Other factor	3654181	Station Wagon/Sport Utility Vehicle	unspecified	Other factor	Tuesday	4	2017	243 DARLINGTON AVENUE	(40.536728000000004-74.193344)
1	2017-05-06	13:00	BRONX	10472	40.829052000000004	-73.85038	(40.829052, -73.85038)	CASTLE HILL AVENUE	BLACKROCK AVENUE	NaN	1	1	0	Failure to Yield Right-of-Way	Other factor	Other factor	3665311	Sedan	unspecified	Other factor	Saturday	5	2017	BLACKROCK AVENUE	(40.829052000000004-73.85038)
2	2017-04-27	17:15	QUEENS	11420	40.677303	-73.804565	(40.677303, -73.804565)	135 STREET	FOCH BOULEVARD	NaN	0	0	0	Driver Inattention/Distraction	Unspecified	Other factor	3658491	Sedan	Sedan	Other factor	Thursday	4	2017	FOCH BOULEVARD	(40.677303-73.804565)
3	2017-05-09	20:10	NaN	NaN	40.624958	-74.145775	(40.624958, -74.145775)	FOREST AVENUE	RICHMOND AVENUE	NaN	1	0	1	Unspecified	Unspecified	Unspecified	3666554	Other factor	Sedan	Other factor	Tuesday	5	2017	RICHMOND AVENUE	(40.624958-74.145775)
4	2017-04-18	14:00	BRONX	10456	40.828846	-73.90312	(40.828846, -73.90312)	NaN	NaN	1167 BOSTON ROAD	0	0	0	Driver Inattention/Distraction	Unspecified	Other factor	3653269	Sedan	Station Wagon/Sport Utility Vehicle	Other factor	Tuesday	4	2017	1167 BOSTON ROAD	(40.828846-73.90312)
5	2017-05-08	10:33	NaN	NaN	40.556453999999995	-74.20777	(40.556454, -74.20777)	WEST SHORE EXPRESSWAY	NaN	NaN	0	0	0	Unsafe Lane Changing	Unspecified	Other factor	3666365	Sedan	Sedan	Other factor	Monday	5	2017	nan	(40.556453999999995-74.20777)
6	2017-05-10	6:10	NaN	NaN	40.740025	-73.97626	(40.740025, -73.97626)	1 AVENUE	EAST 28 STREET	NaN	0	0	0	Passing or Lane Usage Improper	Unspecified	Other factor	3666842	Taxi	Box Truck	Other factor	Wednesday	5	2017	EAST 28 STREET	(40.740025-73.97626)
7	2017-04-24	9:30	BROOKLYN	11203	40.651646	-73.93233000000001	(40.651646, -73.93233)	EAST 48 STREET	CHURCH AVENUE	NaN	0	0	0	Other Vehicular	Other Vehicular	Other factor	3657123	Station Wagon/Sport Utility Vehicle	Station Wagon/Sport Utility Vehicle	Other factor	Monday	4	2017	CHURCH AVENUE	(40.651646-73.93233000000001)
8	2017-04-14	13:00	NaN	NaN	40.7518	-73.817314	(40.7518, -73.817314)	ROBINSON STREET	NaN	NaN	0	0	0	Passing Too Closely	Unspecified	Other factor	3651039	Sedan	Station Wagon/Sport Utility Vehicle	Other factor	Friday	4	2017	nan	(40.7518-73.817314)
9	2017-05-02	1:00	BRONX	10474	40.816864	-73.88274399999999	(40.816864, -73.882744)	NaN	NaN	772 EDGEWATER ROAD	0	0	0	Unspecified	Other factor	Other factor	3661896	Pick-up Truck	unspecified	Other factor	Tuesday	5	2017	772 EDGEWATER ROAD	(40.816864-73.88274399999999)

Last rows

	crash_date	crash_time	borough	zip_code	latitude	longitude	location	on_street_name	off_street_name	cross_street_name	contributing_factor_vehicle_1	contributing_factor_vehicle_2	contributing_factor_vehicle_3	collision_id	vehicle_type_code_1	vehicle_type_code_2	vehicle_type_code_3	crash_day	crash_month	crash_year	nearest_street	combine_location
99990	2019-11-08	19:20	BROOKLYN	11218	nan	nan	(nannan)	OCEAN PARKWAY	AVENUE C	NaN	Unspecified	Unspecified	Other factor	4238828	Sedan	Sedan	Other factor	Friday	11	2019	AVENUE C	(nannan)
99991	2019-11-11	15:55	NaN	NaN	40.66154	-73.98274	(40.66154, -73.98274)	16 STREET	NaN	NaN	Other factor	Unspecified	Other factor	4239244	Sedan	Station Wagon/Sport Utility Vehicle	Other factor	Monday	11	2019	nan	(40.66154-73.98274)
99992	2019-11-13	11:00	BRONX	10461	40.836597	-73.840546	(40.836597, -73.840546)	NaN	NaN	1332 COMMERCE AVENUE	Unspecified	Unspecified	Other factor	4240499	Pick-up Truck	Sedan	Other factor	Wednesday	11	2019	1332 COMMERCE AVENUE	(40.836597-73.840546)
99993	2019-12-04	7:00	QUEENS	11385	40.703407	-73.883484	(40.703407, -73.883484)	NaN	NaN	71-17 69 STREET	Passing Too Closely	Unspecified	Other factor	4252028	Station Wagon/Sport Utility Vehicle	unspecified	Other factor	Wednesday	12	2019	71-17 69 STREET	(40.703407-73.883484)
99994	2019-11-15	13:05	BROOKLYN	11206	40.701862	-73.94383	(40.701862, -73.94383)	WHIPPLE STREET	BROADWAY	NaN	Following Too Closely	Unspecified	Other factor	4242657	Sedan	Station Wagon/Sport Utility Vehicle	Other factor	Friday	11	2019	BROADWAY	(40.701862-73.94383)
99995	2019-11-20	15:00	BROOKLYN	11210	40.618893	-73.94641999999999	(40.618893, -73.94642)	NaN	NaN	1314 EAST 29 STREET	Unspecified	Other factor	Other factor	4244961	Station Wagon/Sport Utility Vehicle	unspecified	Other factor	Wednesday	11	2019	1314 EAST 29 STREET	(40.618893-73.94641999999999)
99996	2019-12-01	11:22	QUEENS	11367	40.72338	-73.81475	(40.72338, -73.81475)	NaN	NaN	150-62 76 ROAD	Unspecified	Unspecified	Other factor	4250093	Station Wagon/Sport Utility Vehicle	Station Wagon/Sport Utility Vehicle	Other factor	Sunday	12	2019	150-62 76 ROAD	(40.72338-73.81475)
99997	2019-11-21	21:30	BROOKLYN	11249	40.71082	-73.96853	(40.71082, -73.96853)	BROADWAY	KENT AVENUE	NaN	Passing Too Closely	Unspecified	Other factor	4245290	Sedan	Box Truck	Other factor	Thursday	11	2019	KENT AVENUE	(40.71082-73.96853)
99998	2019-11-18	17:28	BROOKLYN	11234	40.63118	-73.928185	(40.63118, -73.928185)	NaN	NaN	1695 UTICA AVENUE	Driver Inattention/Distraction	Unspecified	Other factor	4243646	Sedan	Bus	Other factor	Monday	11	2019	1695 UTICA AVENUE	(40.63118-73.928185)
99999	2019-11-17	20:42	MANHATTAN	10017	40.75076	-73.96843	(40.75076, -73.96843)	EAST 45 STREET	1 AVENUE	NaN	Driver Inattention/Distraction	Driver Inattention/Distraction	Other factor	4247517	Sedan	Station Wagon/Sport Utility Vehicle	Other factor	Sunday	11	2019	1 AVENUE	(40.75076-73.96843)

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows